What is claimed is: 

1 . An object activity modeling method comprising the steps 

of: 

(a) obtaining an optical flow vector from a video sequence; 

(b) obtaining the probability distribution of the feature vector for 
a plurality of video frames, using the optical flow vector; 

(c) modeling states, using the probability distribution of the 
feature vector; and 

(d) expressing the activity of the object in the video sequence 
based on state transition. 

2. The object activity modeling method of claim 1 , wherein 
the step (a) is based on affine motion estimation. 

3. The object activity modeling method of claim 2, wherein 
the step (a) further comprises the sub-steps of: 

(a-1) grouping input video frames into a plurality of video frame 
groups and dividing each video frame group as an individual state; 

(a-2) obtaining an affine motion parameter for each video in the 
video frame group of each individual state; and 

(a-3) obtaining an optical flow vector from the affine motion 
parameters. 
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4. The object activity modeling method of claim 3, wherein 
the step (a-2) comprises a step for determining parameters, which 
minimizes summed square difference J](I t (x)-I t _ 1 (x-V(x))) 2 over a 
given video based on the intensity of the pixel on the object, which is 

5 expressed as l t (x)=l t --i(x-V(x)) when I denotes intensity, t denotes time, 
x denotes a pixel location (x, y), and v denotes the motion vector, as 
motion parameters. 

5. The object activity modeling method of claim 1, wherein 
the step (b) comprises a step for calculating probability distribution 
P(Z|Q) by the following equation: 

exp(-^(z-m) T )Q" 1 (Z-m)) 

P ( Z I Q ) = " TTo 

' (2*) N |Q| 1/2 
wherein P=(pi,p2, ... Pd) denotes a motion vector calculated at 
5 each pixel location (x, y), L denotes the number of pixels in a video 
frame or a region of interest, d denotes the number of dimensions, 
feature vector Z, which is a d x L dimension vector, is 
z = (p!>Pi 2 >->p[",P2,P2'-",P2 >Pd>Pdv-Pd) T ' m is tne mean vector of 
feature vector Z, and Q is the covariance matrix of feature vector Z, 
10 and it is assumed that feature vector Z is provided from observation 
class Q. 
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6. The object activity modeling method of claim 1 , wherein 
the step (b) further comprises the steps of: 

decomposing covariance matrix Q as the following equation: 
Q=0 A<D T 

Wherein Z is equal to Z-m, the columns of O are orthonormal 
eigenvectors of covariance matrix Q, and A corresponds to the 
diagonal eigenvalue; and 

calculating probability distribution P(Z|Q) by the following 
equation: 

1 A '' 

Z M+l 

wherein M is the number of principal components, y x is the i-th 
component of Y, cti is the i-th eigenvalue of Q, and p is the optimal 

1 N 

value, which is obtained by p = Ta ; , and it is assumed that 

N-M ^ 

feature vector Z is provided from observation class Q. 

7. The object activity modeling method of claim 1 , wherein 
in the step (c), the object activity in the video sequence is expressed 
using a Hidden Markov Model (HMM), based on state transition. 



P(Z|Q)= 
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8. The object activity modeling method of claim 7, wherein 
the Hidden Markov Model (HMM) is expressed as 5i={3, A, B, n} when 
N is the number of possible states, H satisfies H = {qi, qz, c\h}, A is 
{ay}, the transition between hidden states i and j, B is {bj(.)}, the 

5 observation symbol probability corresponding to state j, and n is the 
initial state distribution, and the state 5 = {qi, q2, qN} and the initial 
state distribution n are determined in advance based on video data. 

9. An object activity recognition method comprising the 
steps of: 

(a) obtaining feature vectors by motion estimation for video 
frames; 

5 (b) determining a state, to which each frame belongs, using the 

obtained feature vectors; and 

(c) determining an activity model, which maximizes the 
probability between activity models and a video frame provided from a 
given activity model dictionary using a transition matrix for the 

10 determined state, as the recognized activity. 

10. The object activity recognition method of claim 9, wherein 
the step (d) comprises a step of finding an activity model, which 
maximizes probability P(0|A,) from the given activity model dictionary 
{X u 5t 2 , A,e}, when T is a positive integer indicating the number of 
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frames forming the video sequence, Zu Z 2 , Z T are feature vectors of 
first frame, second frame, T-th frame, respectively, and if video 
frame 0={Zi, Z 2 Z T } is given and E is the number of state models. 

11. The object activity recognition method of claim 10, 
wherein the transition matrix is obtained by using an expectation- 
maximization (EM) algorithm based on the observation symbol 
probability {bj(.)} corresponding to scene j in the training process. 
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